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The Effective School Battery (ESB) is a diagnostic 
tool used for assessing school climate and providing a sound basis 
for planning and evaluating school improvement programs. This paper 
provides a brief look at the development of the ESB and describes its 
basic features. The ESB servas for diagnosing problems, opening up 
communication, evaluating improvement programs, and providing some 
indicators of a school f s organizational health. Many school 
characteristics cited in the effective schools literature are 
measured by the ESB, though some characteristics un suited to 
measurement are not. The ESB permits development of a comprehensive 
rather than a unidimensional image of the school. Among the 
characteristics tested are school-site leadership, use of 
instructional time, establishment .of goals and expectations, 
recognition of academic achievement, parental involvement, 
orderliness and security of the environment, performance monitoring 
methods, collegiality and collaboration, staff development, 
teacher-student relations, student participation, the sense of 
community, and district support. The standard of effectiveness is 
extended to include character development as veil as academic 
achievement. Practical questions about the ESB are posed and 
answered. Appended are samples of graphs displaying ESB findings, 
tables of the ESB scales and their meanings, and a three-page list of 
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Using the Effective School Battery in School Improvement 
and Effective Schools Programs 



The effective schools movement which now occupies center stage in the 
school improvement arena creates a special opportunity — and a special obliga- 
tion — for researchers to contribute constructively to the improvement of 
schools. In contrast to the technical, abstract, and largely pessimistic 
"school effects" era that the effective schools movement has bulldozed aside, 
we are currently presented with much optimism about inducing more effective- 
ness in schools and with a set of concepts that are widely — if superficially — 
understood fay practitioners and researchers alike. 

In contrast to school effectiveness research which was concerned with "stu- 
dent inputs" and organizational structure variables such as size, staffing 
ratios, and organizational control, the writing on effective schools makes 
greater use of terms such as "climate" and "expectations." Despite limita- 
tions in the research base underlying the new enthusiasm and the new vocabu- 
lary, the effective schools phenomenon has provided us with (Firestone & Her- 
riott, 1982; Purkey & Smith, 1983), it is now a bull market for school 
improvement. The pace at which the effective schools phenomenon has washed 
over American school systems has exceeded researchers 1 and practitioners 1 
capacity to integrate the newfound zeal for school improvement with carefully 
researched tools for assessing schools or planning and implementing improve- 
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ments. 



In this paper* I will show how one comprehensive school climate assessment 



system — the Effective School Battery (ESB) — can be yoked with the effective 
schools movement to provide a sound basis for planning and evaluating school 
improvement programs. 



The ESB grew out of a program of research on school environments my col- 
leagues and I have been engaged in at Johns Hopkins since 1977. We have been 
particularly concerned with developing knowledge about the features of schools 
that lead to safe and orderly learning environments, the conditions necessary 
for implementing school improvement programs effectively, and the characteris- 
tics of school environments and of students themselves that put students at 
high risk of adolescent problem behavior — delinquency, dropout,, and school 
failure. In the course of this program we first explored the dimensions of 
school and community environments that predicted school orderliness (G. Gott- 
fredson & Daiger, 1979; G. Gottfredson, Joffe, & Daiger, 1981; Wiatrowski, G. 
Gottfredson, & Roberts, 1983; G. Gottfredson & D. Gottfredson, 1985). Based 
on survey data for a nationally representative sample of 642 public secondary 
schools, our research implied that it was possible to identify a small number 
of underlying dimensions of school environments that were systematically and 
powerfully related to school orderliness, and also that a larger number of 
more specific dimensions of community, school demographic composition, and 
psychosocial climate were also useful. We found that both researchers and 
practitioners could more easily grasp the meaning and utility of the more spe- 
cific dimensions. 



Dimensions of School Environments 
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The research implied, for example, that global school environment factors 
such as Community Disorganization and Sound School Administration were 
strongly related to school orderliness (inversely and directly, respectively) • 
It also implied, however* that rather specific aspects of school psychosocial 
climate — resources for instruction, firm and clear rule enforcement, teachex^- 
administrator cooperation, and student belief in conventional social rules — 
were directly related to school orderliness. Although these more specific 
dimensions of school climate tended to be nontrivially correlated with other 
specific measures of climate, researchers and practitioners generally found 
that the more global and non-redundant measures of climate were more difficult 
to sink their teeth into. Put another way, most people had difficulty in 
devising specific program based on general factors such as Sound School Admin- 
istration. 

Much the same problem is encountered by practitioners trying to make use of 
the various brief lists summarizing the effective schools literature that sug- 
gest the importance of the "instructional leadership" or "orderly and secure 
environment." Accordingly, in developing the ESB I tried to focus on the con- 
crete dimensions of school environments that were of concern to practitioners 
planning and implementing school improvement programs. I did this because the 
goal of psychometric parsimony conflicts with the goal of creating a compre- 
hensive school assessment tool that has meaning and utility in program plan- 
ning and evaluation. Achieving the former goal but failing to achieve the 
latter would result in a tool with no practical utility. The development of 
psychometrically sound measurement of specific dimensions of school environ- 
ments therefore became an important goal of our research program. 



The Origins of the ESB in the School Action Effectiveness Study 

Between 1980 and 1984 our program conducted the School Action Effectiveness 
Study (SAES; G. Gottfredson, 1982; G. Gottfredson, D. Gottfredson, & Cook, 
1983; D. Gottfredson, 1985) in which we worked with practitioners in educa- 
tional organizations around the country who were designing, implementing, and 
evaluating school improvement programs. In conducting this project, we shared 
with the practitioners involved the need for a comprehensive tool to assess 
the current status of schools, set priorities for school improvement, and 
assess progress as the programs unfolded. We also wanted to incorporate in 
the school assessment tools measures of the specific dimensions our prior 
research implied were linked to school safety and orderliness and to develop 
measures of the risk factors for student misconduct on the one hand, and of 
predictors of success in school and educational persistence on the other. 

A succession of versions of the assessment tool that later became the ESB 
were field tested in the schools involved in the SAES, and they were revised 
and re-examined as that project evolved over the years. The result of this 
iterative process was the current version of the ESB. In this paper I will 
not go into the technical details of the development and validation of the 
ESB — those details are provided in the manual (G. Gottfredson, 1985) . 
Instead, I will describe some practical applications of the device. 

The Effective School Battery 

A school assessment should perform two functions. First, it should provide 
useful information about a school. It should provide information useful in 
understanding what the school is like in comparison to other schools, it 
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should show the school f s strong and weak points, and it should provide bench- 
marks for planning and evaluating school improvement projects* This informa- 
tion should help school personnel make sound decisions about priorities for 
school improvement* Second, a school assessment should help administrators 
and others set priorities and make decisions about the allocation of resources 
and personnel* It should provide useful and detailed information about indi- 
vidual schools so that decisions can rely in part on the unique characteris- 
tics of each school* 

The ESB is used in several ways to perform these functions* 

Diagnosing problems * Schools typically have available only a restricted 
range of systematic information about themselves* They usually have standard- 
ized achievement test scores* information about promotion and retention rates, 
classroom grades, attendance, and enrollment* But unless they take specific 
steps to gather and organize information about such things as faculty morale, 
school safety and classroom orderliness, student attachment to school, percep- 
tions of the fairness and clarity of the school rules, and other aspects of 
school climate, they will have only vague and easily ignored perceptions about 
these matters* Yet the quality of life for everyone in a school and the 
effectiveness of the learning environment depends very much on such aspects of 
school climate* 

The ESB provides a systematic and thorough assessment of school climate and 
the attitudes, perceptions, and behavior of the teachers and students in a 
school. The resulting profiles of the school allow the school to see areas of 
strengths and weaknesses, define problems or goals, and set priorities for 
school improvement efforts* Experience implies that in the absence of such 
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information* schools often fail to direct their school improvement efforts in 
the most productive directions. 

Opening up communication . Schools often experience problems that are not 
openly discussed. An ESB assessment helps to open up and focus discussion 
about the strengths and weaknesses of a school because it provides a mechanism 
for students and teachers to candidly state their views using the structure 
that the assessment instruments provide. The profiles summarize the views of 
many individuals, so a school c*ft be reasonably certain that broad rather than 
isolated experiences are considered. Often a review of the ESB profiles 
raises topics of general concern that have been ignored or overlooked — some- 
times for many years. 

Such discussions can form a basis for a common understanding of school pri- 
orities and goals and serve as a catalyst to planning. Alternatively, admin- 
istrators and faculty may be reassured by a profile that shows their school 
climate to be generally positive, implying that their current practices and 
programs are on the right track. 

Evaluating improvement programs * ESB assessments provide a tool for evalu- 
ating the effectiveness of school improvement efforts. Such assessments pro- 
vide concrete evidence of increases in the effectiveness of schools in many 
areas. For instance, if discipline is a concern in a school, a school initi- 
ating a program to improve discipline can use the ESB student and teacher 
safety scales and the ESB measures of rule clarity and fairness in assessing 
the efficacy of its program. Similarly, school systems interested in the 
relative efficacy of alternative disciplinary programs or procedures can test 
alternative programs in different schools and use the ESB to compare those 
programs. 
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Providing ongoing indicators of organisational health * Schools and school 
systems seeking to monitor school effectiveness in a comprehensive way need 
standardized indicators of how they are doing over time. The ESB can serve as 
one component of a set of school performance indicators to alert administra- 
tors to changes in the conditions of schools as they emerge. Such use of the 
ESB can provide systems with information about the consequences of changes 
made in schools in the system such as consolidation, grade level reorganiza- 
tion, or decentralization of school management. 

An Example of One School's Assessment Results 

To give you a sense for the kind of school assessment the ESB provides, I 
will illustrate its use in one school. I will show you the profiles for one 
school on the periphery of a large Eastern city's urban area. This is a com- 
bined junior-senior high school in a predominantly white community that has 
gradually been engulfed by the enlarging urban area and has recently experi- 
enced the influx of substantial numbers of relatively poor black families, 
many of whom are on public assistance. 

Figure 1 shows this school's ESB psychosocial climate profile based on 
teacher reports. This profile summarizes what teachers said about the school. 
The profile shows bars going out from the 50th percentile to the percentile 
for schools for this particular school. Notice the somewhat depressed morale 
scale, and low scores on race relations and parent /community involvement. 

Figure 2 shows the same school's psychosocial climate according to student 
reports. The low score on the scale measuring respect for students implies 
that students do not feel comfortable with the way they are treated, and the 
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very low score on the scale measuring fairness of rules contrasts with the 
very high score on clarity of rules suggests that the school's rules are very 
clear (perhaps rigid) , but that students do not regard them as fair or equita- 
bly applied. 

In contrast to the previous two figures, Figure 3 summarizes reports of the 
school's inhabitants about themselves. It shows teachers' reports about them- 
selves. Job satisfaction is markedly low in this school — only about six 
schools in a hundred would have average teacher job satisfaction this low or 
lower. This profile also implies that this school's faculty has less positive 
social interaction with students outside the classroom than does the typical 
school , and engage in less professional development activity. Teacher atti- 
tudes tend toward punitive moralism according to the scale measuring nonau- 
thoritarian attitudes. 

Figure 4 shows what students said about themselves. Notice that the socio- 
economic status of the average student is higher than in the typical school 
(most of the school's students are still relatively affluent whites) and that 
students tend to have relatively high educational expectations and high levels 
of belief in conventional social rules. But the typical student dislikes 
school — according to the low score on the scale measuring attachment to 
school — and the typical student reports seldom being rewarded either for aca- 
demic or nonacademic work. 

A brief discussion of these results with the principal and six faculty mem- 
bers implied that the administrator and faculty agreed that these ESB profiles 
accurately described their school. Their integration and interpretation of 
the profiles included the following elaboration: A major source of morale and 
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job satisfaction problems was the faculty's difficulty in adjusting to the new 
composition of the studentry in the school. (Recall that this school is for 
the first time experiencing a sizable influx of lower socioeconomic status 
black students.) As one teacher put it, "It isn't that I'm afraid of these 
students, it's just that I feel so incompetent at dealing with them." The 
principal, who was new to this school this year, seconded that sentiment. He 
said, "My entire experience as an administrator has been in all white schools. 
I really don't know how to approach the families of the black students or get 
them involved in their children's education. " 

Although the principal and staff felt uncomfortable doing so, they decided 
that their number one priority for their school improvement program would be 
to start building faculty competencies in providing education in an integrated 
school and to ensure that they built an integrated school with good race rela- 
tions. The group began to speculate about ways to incorporate black community 
leaders in their planning team. 



The effective schools movement has generated a great deal of enthusiasm 
about the improvement of our nation's schools. Staff development activities 
related to this phenomenon are now omnipresent, and the vocabulary this pheno- 
menon has provided shapes the ways educators currently think about school 
improvement. 

Some of the key elements in the lists of features of schools associated 
with the effective schools movement do not lend themselves to measurement by 
the survey method. For example, classroom use of instructional time and cur- 



How Does the ESB Relate to the Effective Schools Movement? 
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riculum articulation or coherence can not be assessed by the survey method — 
-the assessment of these matters requires classroom observation and the scru- 
tiny of curriculum content. 

In addition, as D. Got tf reds on et al. (1986) have noted, it is not clear 
that the categories in the effective schools lists correspond to measurable 
dimensions of school climate. One source of dissatisfaction — and one major 
source of the proliferation of home-grown school assessment instruments — is in 
the poor psychometric properties of devices tailored explicitly to those 
lists. If users do not believe assessment results, it is very likely because 
they do not provide reliable or valid portraits of their schools. It may be a 
mistake to try to develop school climate instruments to fit exactly the Pro- 
crustean bed of the effective schools movement's language. 

The ESB does measure many of the characteristics of schools usually associ- 
ated with the effective schools literature (Coleman et al., 1982; Corcoran, 
1985; Edmonds, 1979; Fullan, 1985; Lightfoot, 1983; Lipsitz, 1984; Purkey & 
Smith, 1983; Rutter et al., 1979), and it provides the kinds of information 
needed to develop effective schools* A list of the kinds of features associ- 
ated with school effectiveness might look something like this: 

o school-site management and leadership 

o maximized use of instructional time 

o clear goals and high expectations 

o recognition of academic success 

o parental involvement and support 

o orderly and secure environment 
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o a system for monitoring performance and achievements and use of data 
to assess progress 

Some lists of features of effective schools also include these features: 
o collaborative planning and collegia! relations; a bias for action 
o on-going staff development 
o good teacher-student relations 
o high levels of student participation 
o a sense of community 
o district support 

As a practical matter, educational leaders need a way to translate the fea- 
tures of effective schools and the various criteria of school effectiveness 
into practice so that they can determine in what ways specific schools are 
effective and in what ways they need improvement. This is especially impor- 
tant because effective schools use data to assess progress (California Assem- 
bly Office of Research. 1984) . Schools and school systems have available 
tools to assess progress in some areas* They have standardized achievement 
test scores and attendance data, and a few schools have usable disciplinary 
data. The ESB fills the gaps in other areas by assessing features of effec- 
tive schools based on reports about the schools by students and teachers and 
by assessing key criteria of school effectiveness for students and teachers. 

Hog the ESB Can Help Assess the Features of Effective Schools 

The ESB translates the general features of effective schools into concrete 
measures of effectiveness to develop a portrait of a school that identifies 
specific ways in which a school is effective or needs improvement. The fol- 
lowing list explains how the ESB translates the general features identified in 
the effective schools literature into useful measures for schools to use. 
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School-site management and leadership ♦ The ESB collects information from 
teachers about key features of school management and leadership. Teachers 
report whether or not simple non-time-consuming procedures exist for the 
acquisition and use of resources, how well the teachers and administrators get 
along, whether teachers and administrators collaborate toward making the 
school run effectively, whether the principal is aware of and lets the staff 
and students know when they have done something particularly well, whether the 
administration supports the teachers, and whether teachers can communicate 
with the administration and arrange to try innovative practices. These 
aspacts of management and leadership are summarized in an ESB scale called 
Smooth Administration to give a concrete way to assess the effectiveness of 
school-site management and leadership. 

Maximized use of instructional time . The two largest sources of lost 
instructional time in schools are absenteeism and classroom disorder. Schools 
have information about attendance readily available, but they typically lack 
information about classroom orderliness and student attentiveness to learning 
tasks. The ESB collects systematic information about orderliness and atten- 
tiveness to learning tasks. Teachers report how much of their classroom time 
is directed to coping with disruptive student behavior and how much classroom 
disorder keeps them from teaching. Students report on their attentiveness to 
learning tasks; how hard they work in school, whether they attend to homework 
and class assignments, and whether they attempt to complete their work in a 
neat and timely fashion. This information is summarized in a teacher scale 
called Classroom Orderliness and a student scale called School Effort to pro- 
vide two indicators of the use of instructional time. 
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Clear goals and high expectations • Goals and expectations are only mean- 
ingful if they are transmitted to the students. Accordingly, the ESB trans- 
lates this feature of effective schools into concrete form by directly assess- 
ing the educational goals and self-expectations of the students and the clar- 
ity of rules for student conduct. Students report on how far they expect to 
go in school* on whether expectations for their conduct are clear, and on how 
they view themselves and believe teachers view them as a student and a person: 
whether they are satisfied with how they are doing in school, whether teachers 
think they are slow learners, and whether they can be proud of themselves. 
The ESB concretely summarizes goals and expectations by reporting on Educa - 
tional Expectations , Clarity of Rules , and Positive Self-Concept to provide 
measures of school effectiveness in communicating goals and high expectations 
to students. 

Recognition for academic success ♦ Rutter et al. (1979) found that frequent 
use of praise and clear feedback on performance were related to student aca- 
demic achievement, and exemplary secondary schools have implemented programs 
based on the principle of immediate rewards for student success. The ESB 
translates this feature of effective schools into two concrete measures of 
effectiveness. First, it directly collects information about the extent to 
which students are rewarded for school work by asking students how often 
teachers praise their work, whether they got privileges or prizes for their 
individual school work or work as part of a class or group. Second, the ESB 
collects information from teachers about the extent to which they focus their 
principal reward mechanism — grades — on academic work rather than using grades 
in an ambiguous way by contaminating them with responses to student conduct. 
The first dimension is called School Rewards and the second Avoidance of the 
Use of Grades as a Sanction . 
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Parental involvement and support . The ESB makes this feature of effective 
schools concrete by collecting information from teachers about the extent to 
which parents participate in school decisions and serve as tutors or aides, 
how well parents and teachers get along, and whether the parents and community 
are receptive to new ideas and help in reaching the school's goals. The ESB f s 
Parent/Community Involvement dimension provides a way to assess the extent to 
which schools have parental involvement and support. 

Orderly and secure environment . A safe and orderly school environment is 
essential to school ef fectiveness 0 not only because it is linked to academic 
outcomes (Coleman et al.» 1982; Rutter et al., 1979), but also because it is 
an important criterion of effectiveness in its own right (G. Gottfredson & D. 
Gottfredson, 1985). Lightfoot (1983) has suggested that schools become good 
by progressing through a succession of stages where different concerns are 
addressed; safety and security is the first stage. The ESB contains three 
concrete measure of school safety and security. It collects information from 
teachers about the safety of the school by asking them how much of a problem 
vandalism, personal attacks, and theft are in the school; by asking them about 
fear for their safety in dealing with students; and by asking them about the 
safety of a variety of locations within the school. This information is sum- 
marized in the Teacher Safety dimension. Similar information is collected 
from students and s umm arized in the Student Safety dimension. Finally, the 
ESB collects information from teachers about their experiences of theft, prop- 
erty damage, attacks, threats, and obscene remarks and gestures which is sum- 
marized in the Personal Security dimension. These three dimensions provide a 
sound basis for assessing the extent to which a school achieves a safe and 
orderly environment. 
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A system for monitoring performance and achievement and the use of data to 
assess progress . The ESB is a part of a comprehensive system for monitoring 



the performance of the school , identifying school strengths , and diagnosing 
weaknesses that undermine effectiveness. Annual use of the ESB to monitor 
school effectiveness provides a comprehensive and concrete way to monitor 
progress in school improvement when combined with a testing program to syste- 
matically monitor student achievement and a useful attendance system. 

Collaborative planning and collegial relations a bias for action . The ESB 
collects systematic information from both teachers and students about planning 
and action in the school. Teachers report how often they are involved in work 
on planning committees^ whether the principal encourages experimentation in 
teaching, whether teacher evaluation is used to improve teacher performance, 
and whether the principal and faculty are planful and innovative. Students 
report whether the principal and teachers make plans to solve school problems, 
if the school experiments with innovation, or whether it is hard to change the 
way things are done in the school. This information is summarized in two 
scales, one for teachers and one for students, called Planning and Action to 
provide concrete assessments of collegial planning and a bias for action. 

On-going staff development * Research on elementary schools has suggested 
that on-going staff development is a feature of effective schools (Purkey & 
Smith, 1983), and secondary schools with more on-going staff development tend 
to have higher staff morale and display more collegial planning and action 
bias than schools with less staff development (Gottf redson, 1985; cf. Cor- 
coran, 1985). Fullan (1985) highlights the importance of staff development in 
creating more effective schools. The ESB translates this feature of effective 
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schools into concrete terms in its Professional Development dimension. Infor- 
mation is collected from teachers about their involvement in staff development 
activities, their recent training in teaching methods, curriculum content, 
interpersonal relations, new materials and texts, coping with heterogeneous 
classes, and maintaining discipline. The ESB scale provides a concrete way to 
assess the extent to which a school is characterized by on-going staff devel- 
opment • 

Good teacher-student relations . Rutter et al. (1979) and Coleman et al. 
(1982) both found that schools that produced better academic outcomes had more 
frequent student-teacher interaction than other schools, and Lipsitz (1984) 
and Lightfoot (1983) observed that in effective schools for adolescents it 
appeared important that teachers liked and understood the adolescents. Good 
teacher-student relations is a complex feature of effective schools, so the 
ESB provides several specific measures of student-teacher relations. 

First, it collects information from teachers about their interaction with 
students. It asks teachers about the frequency with which students ask for 
advice on problems they are having outside of class, how often they tutor and 
engage in extracurricular activities with students, and how often they discuss 
students 1 personal problems with them. This information is summarized in the 
ESB Interaction with Students dimension. 

Second, the ESB collects information about teachers 1 attitudes towards stu- 
dents—focusing on whether their attitude is strict and punitive or more 
understanding of adolescents. This information is summarized in the Nonau- 
thoritarian Attitudes dimension. 



Third! the ESB collects information from students about how they feel about 
their interactions with the faculty. They are asked if teachers treat stu- 
dents with respect or do things to make students feel "put down." Responses 
are summarized in the ESB Respect for Students dimension. 

Fourth, the ESB collects information from students about their attachment 
to the school and adults in the school. It asks, for example, how important 
what the teachers think about them is; whether they like the school, the prin- 
cipal, the teachers, the counselors; whether they like their classes. The 
responses are summarized in the ESB Attachment to School dimension. 

These four ESB scales provide detailed information about the quality of 
student-teacher relations useful in assessing school effectiveness and diag- 
nosing problems in this area. 

High levels of student participation . Student participation is widely 
regarded as a potential source of school effectiveness (Coleman et al., 1982; 
McPartland et al., 1971; Rutter et al., 1979), and schools regarded as exem- 
plary often have high levels of participation in co-curricular programs (Cor- 
coran, 1985) . The ESB inventories student participation by collecting infor- 
mation from students about their involvement in twelve types of school and 
extracurricular activities. It summarizes participation in a dimension called 
Involvement to provide a concrete assessment of student participation. 

A sense of community . A sense of being part of a supportive community 
appears related to reduced alienation and increased achievement (Purkey & 
Smith, 1983). The ESB translates this sense of community into concrete terms 
by assessing two dimensions of effectiveness. 
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The ESB collects information from students about the extent to which they 
feel integrated with the social order of the school. It asks, for example if 
students feel teachers care about the students, if they feel out of place, if 
they feel like they belong in the school. These student responses are summa- 
rized in the ESB Social Integration dimension. 

The ESB translates this sense of community among teachers into concrete 
terms by collecting information from them about the extent to which they feel 
part of a supportive group: It asks whether the faculty is cohesive, apath- 
etic, enthusiastic; whether their ideas are listened to and used; whether oth- 
ers care about the school; and whether the problems in the school are so big 
that it is unrealistic to expect teachers to make much of a dent in them. 
This information is summarized in the ESB Morale dimension to provide a clear 
indicator of this feature of effective schools. 

District support » The ESB indirectly assesses some consequences of dis- 
trict support. It collects information from teachers about the extent to 
which they are supplied with the material and equipment they need when they 
need it and have the space and physical arrangements they require. This 
information is summarized in the ESB Resources dimension. Other ESB dimen- 
sions also reflect the consequences of district support. These include Pro- 
fessional Development (because time allocations and staff development often 
depend on district assistance or concurrence) , Planning and Action (because 
districts must allow schools sufficient autonomy to undertake school improve- 
ment projects), and Smooth Administration (because personnel decisions and 
supervision of building administrators are district functions) • 
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Broadening the Concept of Effectiveness 



The effective schools literature has focused primarily on academic achieve- 
ment as the ultimate criterion of effectiveness. Yet every administrator 
knows that truly effective schools do more than transmit basic skills and aca- 
demic knowledge. Good schools provide safe, pleasant environments for stu- 
dents and staff. They develop responsible citizens, respect cultural differ- 
ences, develop interpersonal skills, and perform the difficult task of 
encouraging student autonomy in the face of peer influences that adolescents 
find difficult to resist. 

Accordingly the ESB assesses some additional features of school effective- 
ness that take account of this broader perspective on good schools. These 
additional features of good schools include the following: 

Job satisfaction . The ESB measures teacher job satisfaction to provide an 
indication of the quality of work life the school provides for its staff. 

Pro-integration attitudes . A measure of teachers 1 attitudes toward inte- 
grated education is included because of the importance of providing equal edu- 
cational opportunity to all and to provide an indicator of potential difficul- 
ties in integrated schools. 

Positive peer associations . The ESB collects information about the nature 
of students 1 peer relations to provide an indicator of the peer influences to 
which students are exposed in the school. 

Belief in rules . A measure of students 1 belief in conventional social 
rules is included to provide a method for monitoring development as responsi- 
ble citizens. 
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Interpersonal competency . The ESB includes a measure of interpersonal com-' 
petency to allow schools to monitor the development of their students inter- 
personal maturity. 

Avoidance of punishment . Occasionally when schools take steps to improve 
discipline, a needlessly punitive atmosphere is created. Authoritarian con- 
trol mechanisms may lead to alienation as schools attempt to cope with adoles- 
cents who seek independence but who are not fully ready for it (Lipsitz, 
1984) . Accordingly, the ESB supplements the Nonauthoritarian Attitude measure 
with a measure of the extent to which students experience punishment in 
school • 

Summary 

The ESB organizes school assessment results into four profiles that provide 
different kinds of information. 

o Information about the school based on reports by teachers 

o Information about the school based on reports by students 

o Information about the teachers themselves 

o Information about the students themselves 
Tables 1 through 4 describe the dimensions shown in each type of profile 
together with a brief account of the research base implying each is important 
in effective schools. 

. How to Learn More About the ESB 

Technical details about the construction and validation of the ESB are con- 
tained in the User's Manual (G. Gottfredson, 1985), which also contains 
detailed information about the use and interpretation of results. The User's 
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Manual is must reading for professionals interested in school improvement or 
in planning to assess school effectiveness. 

Detailed guidance on the use of the ESB is contained in the User's Manual , 
The manual provides examples of the interpretation of the ESB in practical 
application as well as guidance on administration of the inventories involved. 
Step-by-step instructions for administering the ESB are contained in the Coor - 
dinator's Manual. 



A version of the foregoing paper was presented as part of a symposium at 
the annual meeting of the American Educational Research Association. The fol- 
lowing are some of the questions asked by members of the audience or discus- 
sants at the session and the answers to the questions. 

1. How can I be sure the ESB is reliable and valid for my intended uses? 

Read the manual before making any decision to use the ESB. 

2. The use of the ESB by itself can't be expected to result in school improve- 
ment can it? Should it be used in the context of a more comprehensive 
approach to school improvement? 

The ESB is a tool for diagnosing a school to set priorities for a school 
improvement program and later for assessing progress made by the pro- 
gram. It is an important part of a school improvement program, but it 
is only one part. I recommend using a comprehensive approach to school 
improvement such as that provided by the Program Development Evaluation 
(PDE) method (G. Gottfredson, 1984; G. Gottfredson, Rickert, D. Gott- 
fredson, & Advani, 1984). The PDE method is designed to increase the 
effectiveness of school improvement programs by focusing program plan- 



Some Questions and Answers 
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tiers' attention on the key features of program design they should not 
overlook and to enhance the likelihood that the improvements are put in 
place as intended. The PDE method helps groups solve problems by focus- 
ing on achievable steps in school improvement so that progress is visi- 
ble at each step and the improvement team is rewarded for progress as it 
goes along. 

Is the ESB for use only with the PDE method, or can it be used with any 
school improvement method? 

The ESB is a generic tool. You can use it in conjunction with any 
school improvement method. For example, you could use it instead of the 
informal audits used when following the Phi Delta Kappa approach, or you 
could use it with the Northwest Regional Lab's planning model, or with 
other methods of school improvement. 
What do you tell a planning team when their school profile indicates race- 
relations problems? 

I tell them to believe the profile, and — if considering everything else 
they know about the school — race relations appears to be a problem area, 
that they should consider including a goal of improving race relations 
among their priorities. I discourage them from ignoring the problem. 
The ESB profiles summarize scores on scales. Wouldn't it also be helpful 
to show results item by item? 

No. If you use a device where the items in the scales do not hang 
together — i.e., they do not all measure the same dimension — then you 
often have no alternative but to stare at the items and try to figure 
out what they mean. Single items are unreliable indicators. But the 
scales in the ESB have been subjected to repeated item analysis so that 
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we know all items in a scale tend to measure the same dimension. The 
scales summarize this information and make it more interpretable by pre- 
senting reliable (homogeneous) scale scores. The profiles focus atten- 
tion on the overall summary of results—they give a comprehensive pic- 
ture. Planning groups can not really integrate the information from 
pages and pages of printouts on individual items. Furthermore, there 
are norms for the scales. Users have nothing to go on but hunches when 
trying to decide whether the responses to an individual item on the ESB 
(or any other inventory) are more favorable or less favorable than the 
responses that would be obtained in a typical school. I do encourage 
people to read the item content of the scales when interpreting ESB pro- 
files. The item content is spelled out in the manual. 

Can the ESB results be disaggregated to compare the responses of different 

groups in a school. 

Sure. I recommend looking at disaggregated reports mainly for the stu- 
dent population characteristics. This will give you information about 
the characteristics of groups of students. You should sort the answer 
sheets separately by the student groups for which you want disaggregated 
results before you send it off for scoring and.be sure to indicate 
clearly how you want the ESB scored. 

The ESB seems expensive. Why is it so expensive and is there any way to 

reduce the cost? 

Don't be fooled by surveys that look inexpensive just because you can 
photocopy materials or purchase materials at a low cost. There are 
always costs involved in preparing material s, scoring the results, and 
preparing reports. Hidden personnel costs can be very high, and when 
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materials are scored locally (in a school or in a district evaluation 
office) you can not be sure the scoring is free of errors (and you may 
have no normative data with which to compare the results) . The costs of 
using the ESB include automated scoring and report preparation by a 
licensed scoring service so you get professionally prepared reports that 
you know are free of errors. The cost of using the ESB teacher instru- 
ment is about the same as other machine-scored devices. You can save 
money on student assessments by conducting a survey of a random sample 
of 200 to 300 students. If you can draw a random sample — and do not 
need disaggregated results — use the sample. 
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Tabk 1 

Effective School* and School Climate as Aawssed by ESB Teacher Reports 



ESB Cfianate Scab 
(Teacher Riposte) 



School Characteristic* Assockted 

with School Sneeees According t° R**tar*h 



Safety 



Monk 



Planning tad Actios 



3 moot* 

Adminktratioa 



Rmoum 



Race Relatione 



Parent/Commeaity 
Involvement 



Stadeat Inftnence 



Avoidance of the Use 
of Grades 
m a Sanction 



Indicates bow tali teachers report the 
tcaool environment to be. 



ladkataa tha degree of enthusiasm of 
a echod'a faculty aad faculty 
confide aca la Ike ecaooL A high 
•core meaaa that teachers feel they 
caa coaat oa ike sappori of o there la 
Ike school; a low acore Impose ikai 
many teeebere believe school 
Improvement le hopeless. 

ladkatea teacker reporia of ike degree 
to whkh ike eckool Ukaa aa 
experimeaUag or laaovathre approach 
to plaaalag acaool UnprovcmeaU aad 
it opea to confront rather tkaa Ignore 
emerging probkm*. 



ladkataa kow teackera pcrcetvc ike 
eckool adminktratioa. A klgk acora 
Implka Ikai teackera perceive ikai 
they get ike kelp tkey aeed to do 
their jobe whea tkey need it, tkat tke 
edmlaietrator k supportKs of teackera, 
that admiaktratora reward staff for 
doing a good job, aad that there k 
Uttk eouflkt or teaaloa betweea 
teaching itaff aad admiaktratora. 

Ir/dkatee whether teackera report 
aJeqeate iastrmctloaal eapplka aad 
other reaoarcea or whether tkey report 
difficulty la obtaining needed teaching 
supplies, 

ladkatea (la Integrated ocbook) how 
well different ethnic groope get along. 



ladkatea tke degree to which 

tke eckool aeea community reaoarcea 

in It* program*. 



ladkatea teacher perception* of the 
extent to whkh stadeats partkipata la 
school deckloaa. 



ladkataa tke extent to whkh 
teackera avoid lowering grades 
la rcepoaaa to stadeat misconduct, la 
low scormg schook teachers report 
(reqaeaUy lowering acaool grades as a 
dkclpilaary practice, tkaa mfadag . 
ctspoasfa to ncademk performance 
wttk rrapoaee* to stadeat coadact. 



A safe regmlated caviroamaut for teacbcr-itadcat rcUUoaa 
(Ughtfooi, 10U); pkaaaat working coadltloa* for staff aad 
•tadeat* (Eatter st aL, 10T0) Llpslis, 1M4)| few disciplinary 
problems (Cokmaa ei at, IMS). 

A aeaaa of commaalty {Ughtfooi, 10U); tke feetleg of belag a 
part of a supportive commaalty (Farkey le Smith, 10*9)1 a 
tease of belag special as a sckool aad a climate of positive 
attitadea aad high expectation* (Upeftts, 1M4). 



Collaborative plaaalag aad collegia! reUtloasafpa (Parkey le 
Smith. 1M*)| clear goak (CaHforak Assembly Office of 
Research. 19*4) | greater ase of date to aaaaaa progress 
(California Assembly, IMah oagotag carrkalam review 
lavoMag teackera (California Aassmbly, I0M)| eatoaomy to 
eoKe acaool probkm* (California Assembly, 1044); awarcaesa of 
Imperfection* aad wfflfagaese to search for solatloa* (Ughtfooi, 
1M*)| dear aathority to solve problems (Ughtfooi, 1MS)| 
ckariy artkakted aad shared school goak (UpslU, 19*4). 

Leadership la ta^m^t and maia taming tke Improvement 
process (Parkey le Smith, im)i Uttk adxniaktratVoa-Uacher 
coafflet (Corbett et aL, 10*4); priaeipal sappori for laaovatlon 
(Bermaa le MeUaghfta, lVtt)\ priaeipal leadership (CaBfomia 
SUte Department of Idneatiom, 10*0)1 kaderakip fitting the 
caltara of the acaool (Ughtfooi, 19*3)| respect for teachers and 
teaching (Ughtfooi, IMS)* respect for staff a* profcssloaak 
(Upsita, 10*4)| encouragement of staff lagcaaity (Upsita, 10*4). 



Resources for laatractka are linked to staff morak, Job 
satkfactloa, aad acaool safety (Gottfredsoa, 10*S| Gottfredsoa It 
Gottfredsoa, 10*&). 



A concern for the weakest member* of the school commanHy 
(Llghtfbot, 10S3): reciprocity In human relations (Upsita, 10*4). 
(Good race relatione are aa Important dimension of school 
effectiveness la their own right) 

Parents are Informed of school goak aad stadeat responeibllltlee 
(Parkey le Smith, 10S*)| parent*! involvement k related to 
achievement la schook serving poor minority children 
(Brookover et aL, 1OTQ)| parental involvement may lead to 
greater eoneeaene oa goak aad behavioral norma between ike 
reboot aad tke komc (Salgaak le KarweH, 1011). 

High proportion of atedeate holding positions of responsibility 
aad shared actMtka betweea ataff aad stadeaU (Ratter et aL. 
107d)l awareneaa of stadeat vame* (Ughtfooi, 19**)i reciprocity 
In soman rektioaa ( Upeit 10*4); stadeat partkipatloa in 
decision makiag (kfePartlaad et aL, Iflfl). 

Coaaktent pelkka aad procedare* (Ratter ei aL, 10T9)| freqeeat 
nee of direct praise aad freqaent feedback oa performance; 
separation of responses for academk performance and stadeat 
coadact (McPartlaad le McDffl, 10TT)| amblgaona sanction* lead 
to dkorder (Gottfredaoa le Gottfredsoa, IMS). 
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Table 2 

Effective Schools and School Climate as Assessed by ESB Student Reports 



ESB Climate Scale 

(Student Report) Meaning 



School Characteristics Associated with 
School Success According to Research 



Safety 



Respect for Students 



Planning and Action 



Fairness of Rules 



Clarity of Rules 



Student Influence 



Indicates how safe students 
report the school environment 
to be. 



Il .icates how students feel 
they are treated in the 
school. A high score means 
students are treated with dig- 
nity; a low score suggests 
that students are treated with 
a lack of respect. 

Indicates student reports of 
the degree to which the school 
undertakes efforts to plan and 
implement school improvement. 



Indicates whether students 
believe the school's rules are 
equitable and fairly adminis- 
tered. Low scores imply that 
students perceive injustice or 
inequity; high scores imply 
they perceive fairness and 
even— handed rule enforcement. 

Indicates whether students 
know what the school rules 
are — and what the consequences 
are for rule violation. 

Summarizes the students' point 
of view about the extent to 
which they are able to influ- 
ence matters of concern to 
them. A low score implies 
students feel powerless to 
bring about desired changes in 
school practices; a high score 
implies students feel the 
school is open to their sug- 
gestions. 



A safe regulated environment for teacher-student 
relations (Lightfoot, 1983); pleasant working con- 
ditions for staff and students (Rutter et al. t 
1079; Lipsitz, 1984); few disciplinary problems 
(Coleman et aL, 1982). 

A concern for the weakest members of the school 
community (Lightfoot, 1983); a caring environment 
and reciprocity in human relations (Lipsitz, 1984); 
avoidance of "degradation ceremonies" (Greenberg f 
1977). 



Collaborative planning and collegial relationships 
(Purkey & Smith, 1983); clear goals (California 
Assembly Office of Research, 1984); greater use of 
data to assess progress (California Assembly, 
1984); ongoing curriculum review involving teach- 
ers (California Assembly, 1984); autonomy to solve 
school problems (California Assembly, 1984); aware- 
ness of imperfections and willingness to search for 
solutions (Lightfoot, 1983); clear authority to 
solve problems (Lightfoot, 1983); clearly articu- 
lated and shared school goals (Lipsitz, 1984). 

Fairly and consistently enforced school rules (Pur- 
key & Smith, 1983); discipline perceived as fair 
and strict (Coleman et al., 1982); perceived fair- 
ness of rules (Gottfredson & Gottfredson, 1985). 



Clear, reasonable rules (Purkey & Smith, 1983); 
clear guidelines for student behavior Mid disci- 
pline infrequent but firm (Rutter et aL, 1979); 
perceived clarity of rules (Gottfredson & Gottfred- 
son, 1985). 

High proportion of students holding positions of 
responsibility and shared activities between staff 
and students (Rutter et al., 1979); awareness of 
student values (Lightfoot, 1983); reciprocity in 
human relations (Lipsitz, 1984); student participa- 
tion in decision making (McPartland et al., 1971). 



TabU 3 

Effective Schools and Teacher Characteristics Assessed by the ESB 



ESB Teacher Scale 



Meaning 



School Characteristics Associated 

with School Success According to Research 



Pro-integration 
Attitude 



Job Satisfaction 



Interaction with 
Student* 



Personal Security 



Classroom 
Orderliness 



Professional 
Development 



Non authoritarian 
Attitudes 



Indicates teacher attitudes 
toward integrated education. 
A high score suggests that 
teachers view integrated edu- 
cation in a positive way; a 
low score suggests that the 
average teacher may be some- 
what insensitive to issues of 
racial equity. 

Indicates how the teachers 
feel about their jobs — a meas- 
ure of the quality of work 
life in the school 

Indicates how much positive 
social interaction teachers 
have with students. 



Indicates the average teach- 
er's experience of personal 
victimisation. 

Indicates how orderly the 
average teacher's classroom 
is. A low score implies that 
disruption interferes with 
teaching in many classrooms. 

Indicates how much exposure 
to continuing education the 
average teacher has had in the 
past year. 

Indicates teachers' attitudes 
about student— teacher author— 
ity relations. A low score 
implies many teachers have a 
punitive, moralistic attitude 
about student misbehavior. 



Teachers who want minority children to learn and 
believe that they can (Bloom, 1976; Edmonds, 1979); 
assigning students of different races to work 
together leads to positive racial attitudes (Slavin 
k Madden, 1979); effective integrated schools 
recruit and retain teachers who are unprejudiced 
and insistent on high performance and racial equal- 
ity (Hawley, 1981). 



A climate of positive attitudes (Lightfoot, 1983); 
teacher interest in students (Coleman et al., 
1982); pleasant working conditions, teachers model- 
ing desired work norms (Rutter et al., 1979). 

Teachers available for consultation and provide 
personal assistance, shared activities between 
staff and students (Rutter et al., 1979; more fre- 
quent student-teacher interaction (Coleman et a]., 
1982). 

An environment which safe (Purkey k Smith, 1983). 



Classroom disorder is one of the main sources of 
lost instructional time (Karweit, 1983); fewer dis- 
ciplinary problems (Coleman et al., 1982); an ord- 
erly environment (Lipsitz, 1984). 



School wide staff development (Purkey k Smith, 
1983); social interaction and dialogue about teach- 
ing (Little, 1982). 



Safer schools have teachers with less punitive 
attitudes (Gottfredson k Gottfredson, 1985); and 
orderly and caring environment (Lipsitz, 1984). 



Effective Schools and StudVnt Characteristics Assessed by the ESB 



ESB Student Scale 



Meaning 



Student Outcome 



Positive Peer 
Associations 



Educational 
Expectation 



Social Integration 



Attachment to School 



Belief in Roles 



Interpersonal 
Competency 



Describes peer relations 
for the averagi student. A 
high score meai\s most students 
have friends who value school 
and avoid trouble. 

Indicates the level of 
student academic orientation. 
A high score means the average 
student expects to complete a 
great deal of education. 

Indicates whether students 
feel integrated with or alien- 
ated from the social order of 
the school 



Indicates students' liking for 
school. 



Indicates the extent to which 
students believe in the valid- 
ity of conventional social 
rules. 



Indicates the degree to 
which the average student is 
competent in interpersonal 
relations. 



Youths who score low on this scale tend to engage 
in more delinquent behavior, and those who score 
high are more attached to school and have higher 
educational expectations (Gottfredson, 1985). 



High expectations of academic success (Rutter et 
a!., 1979); a climate of high expectations (Lip— 
sits, 1983). 



A sense of community (Purkey k Smith, 1983); social 
integration is an important criterion of effective- 
ness in its own right — alienated individuals tend 
to be unhappy and at risk for mental health prob- 
lems (McClosky k Scharr (1966). 

An important criterion of effectiveness in its own 
righs. Secondary schools are often dismally drab 
and boring places (Boyer, 1983). 

An important criterion of effectiveness in its own 
right. Students who report little belief in con- 
ventional rules tend to engage in more delinquent 
behavior than other students (Hirschi, 1969; Gott- 
fredson, 1986) and schools where students believe 
in the validity of rules experience less teacher 
victimization (Gottfredson k Gottfredson, 1985). 

An important criterion of effectiveness in its own 
right; an aspect of psychosocial maturity (Holland 
k Baird, 1968). 



Involvement 



Indicates the extent of the 
average student's participa- 
tion in extracurricular activ- 
ities. 



High participation in extracurricular activities 
(Coleman et al., 1982). 



Positive 
Self- Concept 



School Effort 



Avoidance of 
Punishment 



School Rewards 



Indicates how students 
describe themselves. A high 
score means the average stu- 
dent has high self-esteem and 
sees him/herself as a rule-a- 
biding person. 

Indicates how much care and 
effort the average student 
devotes to school work. 

Summarizes information 
about how often the average 
student is punished. 

Indicates how much the average 
student is rewarded for his or 
her academic behavior. 



Higher levels of student self-esteem (Coleman et 
al., 1982); an important criterion of effectiveness 
in its own right. Students scoring low tend to 
engage in more misconduct; high scorers score 
higher on measures of psychological health and 
reading ability (Gottfredson, 1985). 

Students doing more homework (Coleman et al., 
1982); homework frequently assigned and marked 
(Rutter et al., 1979). 

Discipline infrequent but firm (Rutter et al., 
1979); positive student-teacher relations (Lipsitz, 
1984; Lightfoot, 1983). 

Recognition for academic success (Purkey k Smith, 
1973); frequent use of direct praise and frequent 
feedback on performance (Rutter et al., 1979). 
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